10/529A80 



S03P1126 



1/24 



too 




CD 



CZ> I 



LU 

CI30 
LUO 



— 

CD 113 
Ol— o 

LU <x: — 
— -< 

CI7 UJ 

O — CD 



.CO 



lINn 9N I HOI IMS 









LU 




LU 














1 




UJ 




UJ 








> 




> 


/ \ 




/ \ 



CO 

I 



o 

UJ 



CO 

I 



CD 



CD 
UJ 



10/529480 



S03P1126 

2/24 



Fig.2 




r 



10/529480 



S03P1126 



3/24 




ti 
CD 




10/52948 

S03P1126 



4/^24 



I 

LU 



107529480 



S03P1126 

5/24 




10/529480 



S03P1126 



6/24 



CO 
CO* 



Q-l— 
GO 



CO 



LO 
CO 



CD ZD 



CO 
CO" 



SO 
LU 



CO 
bX) 



CO 



LU 

LUCD 
LU 



E 





CD 






REPRODUCT 1 
UNIT 




/ 












iCORDI 
iDIUM 




■ ■ ■ 


■ ' ■ 



cr3 



CD ZD 



f 



7/24 



10/ 5 29 A 80 

S03P1126 




8/24 



Fig. 8 



10/529A80 

S03P1126 



61 



PROCESSING AND 
SPLICING UNIT 



T 



62- FRAME MEMORY 



63- 



OVERLAP PIXEL 
DETECTING UNIT 



64- 



DIFFERENCE 
CALCULATING UNIT 



65 



COMPARING UNIT 



66- 



ADJUSTMENT AMOUNT 
DETERMINING UNIT 



-13 



^.^ . ..^ Ml- 



10/529A80 



S03P1126 



9/24 

Fig.9 

CSTART OF OMNIDIRECTIONAL IMAGE DATA GENERATION PROCESSING) 

r 



GENERATE AND STORE TEMPORARY OMNIDIRECTIONAL IMAGE 
DATA IN FRAME MEMORY, AND INITIALIZE COUNTER n 



INITIALIZE COUNTERS x. D. DR-x DG-x AND DB-x 



S2 



READ OUT n-TH FRAME 



S8 



INCREMENT 
X BY 1 



S3 



DETECT OVERLAP PORTION OF 
PICTURE Px WITH PICTURE P(x+1) 



84 



CALCULATE ABSOLUTE VALUES DR-x. DG-x AND 
DB-x OF DIFFERENCES IN RGB COMPONENTS 

I 



S5 



No 



X+1 



WITH THE 



ACCORDS 
JMBER 
CAMERAS? 



J7 



OF VIDEO^ 





jYes 


S9 




DETECT OVERLAP PORTION OF PICTURE 
P(x+1) WITH PICTURE PI 








CALCULATE ABSOLUTE VALUES DR-(x+1), DG+(x+1). 
AND DB-(x+1) OF DIFFERENCES IN RGB COMPONENTS 





S13 



SHIFT 
PICTURES 



S10 



CALCULATE D= 

D+ (DR- (x+1 ) + (DG- (x+1 ) + (DB- (x+1 ) ) 




D>THRESHOLD th?~ 



> 


No 


OUTPUT OMNIDIRECTIONAL 


MAGE DATA FOR ONE FRAME 



S14 




COUNTER n IS 
INCREMENTED 
BY 1 



10/24 



Fig. 10 



10/529480 



S03P1126 



61 



PROCESSING AND 
SPLICING UNIT 



62- FRAME MEMORY 



63- 



OVERLAP PIXEL 
DETECTING UNIT 



64- 



DIFFERENCE 
CALCULATING UNIT 



71 



DIFFERENCE LOGARITHM 
TRANSFORMATION UNIT 



72 



COMPARING UNIT 



66- 



ADJUSTMENT AMOUNT 
DETERMINING UNIT 



-13 



10/529A80 

S03P1126 



10/529480 

S03P1126 



12/24 

Fig. 12 



CSTART OF OMN I D I RECT I ONAL I MAGE DATA GENERAT I ON PROCESS I NG ) 



GENERATE AND STORE TEMPORARY OMNIDIRECTIONAL IMAGE 
DATA IN FRAME MEMORY, AND INITIALIZE COUNTER n 



S31 



INITIALIZE COUNTERS x, D. DR-x DG-x AND DB-x 



Jl 



S32 



READ OUT n-TH FRAME 



S38 [ 



INCREMENT 
X BY 1 

T 



DETECT OVERLAP PORTION OF 
PICTURE Px WITH PI CTURE P(x+1) 



S33 
S34 



CALCULATE ABSOLUTE VALUES DR-x. DG-x AND 
DB-x OF DIFFERENCES IN RGB COMPONENTS 

I 



S35 




S36 



DETECT OVERLAP PORTION OF PICTURE 
P(x+1) WITH PICTURE PI 



S39 



S44 



SHIFT 
PICTURES 



CALCULATE ABSOLUTE VALUES DR-(x+1), DG+(x+1), 
AND DB-(x+l) OF DIFFERENCES IN RGB COMPONENTS 



± 



CALCULATE D=D+ (DR- (x+1 ) + (D G-(x+1) + (DB-(x-t-1)) 

. i 

^ S42 



S40 
S41 




> 


No 

f 


OUTPUT OMNIDIRECTIONAL 


MAGE DATA FOR ONE FRAME 



S45 




S47 



COUNTER n IS 
INCREMENTED 
BY 1 

H 



10/529A80 



13/24 



Fig. 13 



S03P1126 



61 



PROCESSING AND 
SPLICING UNIT 



62- 



FRAME MEMORY 



63- 



OVERLAP PIXEL 
DETECTING UNIT 



81- 



DIFFERENCE 
CALCUUTING UNIT 



82H 
82a 

83' 



DIFFERENCE MEDIAN 
DETECTING UNIT 



MEMORY 



COMPARING UNIT 



66- 



ADJUSTMENT AMOUNT 
DETERMINING UNIT 



-13 



10/529480 



S03P1126 



14/24 

Fig. 14 



CSTART OF OMNIDIRECTIONAL IMAGE DATA GENERATION PROCESSING ) 

^ S61 



GENERATE AND STORE TEMPORARY OMNIDIRECTIONAL IMAGE 
DATA IN FRAME MEMORY, AND INITIALIZE COUNTER n 



INITIALIZE COUNTERS x. DR-x. DG-x, DB-x, MD. MDR. MDG AND MDB 



READ OUT n-TH FRAME 



S67 



INCREMENT 
X BY 1 



DETECT OVERLAP PORTION OF 
PICTURE Px WITH PICTURE P(x+1) 



S63 
S64 



S62 



± 



CALCULATE ABSOLUTE VALUES DR-x. DG-x AND 
DB-x OF DIFFERENCES IN RGB COMPONENTS 



S65 



^66 

X+1 ACCORDS 
JITH THE NUMBER OF VIDEO, 
CAMERAS?, 



DETECT OVERLAP PORTION OF PICTURE 
P(x+1) WITH PICTURE PI 



S68 



S73 



SHIFT 
PICTURES 



CALCULATE ABSOLUTE VALUES DR-(x+1). DG+(x+l), 
AND DB-.(x+1) OF DIFFERENCES IN RGB COMPONENTS 



CALCULATE MEDIANS MDR OF DR-1 TO DR-8, MDG OF 
DG-1 TO DG-8, AND MDB OF DB-1 TO DB-8 

I 



S69 



S70 






No 


OUTPUT OMNIDIRECTIONAL 


MAGE DATA FOR ONE FRAME 


3 





374 



S76 



COUNTER n IS 
INCREMENTED 
BY 1 



OF ALL FRAMES IS 
JINISHED2- 
fYes 



15/24 



Fig. 15 



10/529A80 



S03P1126 



95 



61 

_L 



PROCESSING AND 
SPLICING UNIT 

J~ 



62-xj 
> 



FRAME MEMORY 



63- 



OVERLAP PIXEL 
DETECTING UNIT 



91 



91a 



92- 



MEDIAN 

DETECTING UNIT 



MEMORY 



DIFFERENCE 
CALCULATING UNIT 



DIFFERENCE 
MEDIAN 

DETECTING UNIT 



MEMORY 



93 



COMPARING UNIT 



95a 



66- 



ADJUSTMENT AMOUNT 
DETERMINING UNIT 



94 



FRAME 

MISALIGNMENT 
DETECTING UNIT 



13 



10/529480 



S03P1126 



16/24 

Fig. 16 



CSTART OF OMNIDIRECTIONAL IMAGE DATA GENERATION PROCESSING) 




GENERATE AND STORE TEMPORARY OMNIDIRECTIONAL IMAGE 
DATA IN FRAME MEMORY. AND INITIALIZE COUNTER n 

1 



S91 



S92 



INITIALIZE COUNTERS X. YR-xt-n. YG-xt-n. YB-xt-n, YR-xb-n, 
YG-xb-n, YB-xb-n, MYRxt, MYRxb, MYGxt. MYGxb. MYBxt. MYBxb. 
MDA. MDRx. MDGx AND MDBx 



READ OUT n-TH FRAME 



S93 



S97 



INCREMENT 
x BY 1 



DETECT OVERLAP PORTION OF 
PICTURE Px WITH PICTURE P(x+1) 



S94 



CALCULATE YR-xb-n. YG-xb-n. YB-xb-n, 
YR-(x+1)t-n, Y6-(x+1)t-n AND YB-(x+1)t-n 



INCREMENT 
n BY 1 



S101 




S95 



DETECT OVERLAP PORTION OF PICTURE 
P(x+1) WITH PICTURE PI 



S98 



SHIFT 
PICTURES 



CALCULATE YR-(x+1)b-n, YG-(x+l)b-n, YB-(x+1)b-n. 
YR-lt-n, YG-lt-n AND YB-lt-n 



^SlOO 

PROCESSING 
ON ALL FRAMES IS 
FINISHED? 



INCREMENT 
x BY 1 


S105 


1 


No_ 




S99 



CALCULATE MYRxt, MYRxb. MYGxt. 
MYGxb, MYBxt AND MYBxb 




S115 



® 



10/529480 

S03P1126 

17/24 



Fig. 17 



® 



INITIALIZE COUNTER x 



INCREMENT 
X BY 1 



S110 



SI 06 



CALCULATE DIFFERENCE ABSOLUTE VALUES MDRx BETWEEN 
MYRxb AND MRY(x+1)t. MDGx BETWEEN MYGxb AND 
MYG(x+1)t. AND MDBx BETWEEN MYBxb AND MYB(x+l)t 



I. 



SI 07 



CALCULATE MDA=MDA+MDRx+MDGx+MDBx 




SI 08 



CALCULATE DIFFERENCE ABSOLUTE VALUES MDRx BETWEEN 
MYR(x+1)b AND MYRIt, MDGx BETWEEN MYG(x+1)b AND 
MYGIt. AND MDBx BETWEEN MYB(x+1)b AND MYBIt 



I 



CALCULATE MDA=MDA+MDR (x+1 ) +MDG (x+1 ) +MDB (x+1 ) 




S111 



S112 



S113 

MDA>THRESHOLD thlflA?" 



FRAME MISALIGNMENT DETECTION PROCESSING 



S114 



( END ) 



10/529A80 

S03P1126 



18/24 

Fig. 18 

CSTART OF FRAME MISALIGNMENT DETECTION PROCESsIng ) 

I 

IS131 



INITIALIZE COUNTER n 



INITIALIZE COUNTERS x. D. DR-x DG-x AND DB-x 



1 



S132 



READ OUT n-TH FRAME 



SI 38 r 



INCREMENT 
X BY 1 



DETECT OVERUP PORTION OF 
PICTURE Px WITH PICTURE P(x+1) 

i 



SI 33 
SI 34 



CALCULATE ABSOLUTE VALUES DR-x, DG-x AND 
DB-x OF DIFFERENCES IN RGB COMPONENTS 



S135 



CALCULATE D=D+ (DR-x) + (DG-x) + (DB-x) 



SI 36 



_S137 

X+1 ACCORDS 
JITH THE NUMBER OF VIDEO^ 
JJAMERASt 

[Yes 



DETECT OVERLAP PORTION OF PICTURE 
P(x+1) WITH PICTURE PI 



SI 39 



CALCULATE ABSOLUTE VALUES DR- (x+1 ) . DG+ (x+1 ) , 
AND DB-(x+1) OF DIFFERENCES IN RGB COMPONENTS 



Jl 



CALCULATE D=D+ (DR- (x+1 ) + (DG- (x+1 ) + (DB- (x+1 ) ) 



SI 40 
S141 



DISPLAY FRAME 

MISALIGNMENT 
1 




SU2 
D>THRESHOLD ^hf 



SI 44 



SI 43 



S146 



COUNTER n IS 
INCREMENTED 
BY 1 



OUTPUT OMNIDIRECTIONAL IMAGE DATA FOR ONE FRAME 



"PROCESSING^ 
OF ALL FRAMES IS 
FINISHED! 

[Yes 



(return) 



19/24 



Fig. 19 



10/529480 



S03P1126 



61 



PROCESSING AND 
SPLICING UNIT 



62- FRAME MEMORY 



63- 



OVERUP PIXEL 
DETECTING UNIT 



101- 



LAPLACIAN FILTER 
PROCESSING UNIT 



102- 



EDGE DIFFERENCE 
COMPARING UNIT 



mi ^ADJUSTMENT AMOUNT 
DETERMINING UNIT 



-13 



10/529480 

S03P1126 

20/^24 

Fig. 20 



1 


1 


1 


1 


-8 


1 


1 


1 


1 



10/529480 

S03P1 126 

21/24 

Fig.21 




Fig. 22 



10/529A80 

S03P1126 



22/24 

Fig. 23 

T1 T2 T3 T4 T5 




T12 T13 T14 T15 T17 



10/529480 



S03P1126 



23/24 

Fig. 24 



( START OF POSITION CORRECTION PROCESS I NG > 

^1^ 



GENERATE AND STORE TEMPORARY OMNIDIRECTIONAL IMAGE 
DATA IN FRAME MEMORY. AND INITIALIZE COUNTER n 

1- 



S161 



INITIALIZE COUNTERS x, FD AND DS-x 



SI 62 



READ OUT n-TH FRAME 



SI 69 



INCREMENT 
X BY 1 



DETECT OVERLAP PORTION OF 
PICTURE Px WITH PICTURE P(x+1) 



SI 63 
SI 64 



MULTIPLY LAPLACIAN FILTER BY OVERLAP 
PORTION OF PICTURE Px WITH PICTURE P(x+1) 



SI 65 
SI 66 



CALCULATE MISALIGNMENT WIDTH DS-x OVERLAP PORTION 



SI 75 




DETECT OVERLAP PORTION OF PICTURE P(x+1) WITH PICTURE PI 






SI/1 
SI 72 




MULTIPLY LAPLACIAN FILTER BY OVERLAP PORTION OF 
PICTURE Px WITH PICTURE P(x+1) IN RGB COMPONENTS 






CALCULATE MISALIGNMENT WIDTH DS-(x+l) OF OVERLAP PORTION 



CALCULATE FD=FD+DS- (x+1 ) 



SI 73 



^174 

FD>THRESHOLD 
Jh-F? 

[No 



Yes 



SI 76 



SI 78 



OUTPUT OMNIDIRECTIONAL IMAGE DATA FOR ONE FRAME 




COUNTER n IS 
INCREMENTED 
BY 1 



J 



10/529480 

S03P1126 



24/24 



< > 



LU 



CM 

OsJ 

CO 

Cvj 

CSJ 
CM 
CM 



eg 



CO 
CM 



LO 
CM 



LO 
CVJ 



Q_ 

I— 



CSJ 
CVJ 



CD 



LU 

or I 
o- 
I — ; 
co: 



cn 

CM 



oo 

CM 



I — 

CM 



CSJ 



CD 



CL. ■ 



CO 

I — c=> 

CM 



